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DETAILED ACTION 
Remarks 

1. Claims 1-19 have been examined. Claims 1-19 have been rejected. This 
document is the first Office action on the merits. 

Information Disclosure Statement 

2. The information disclosure statement is being considered by the examiner. 

Specification 

3. The lengthy specification has not been checked to the extent necessary to 
determine the presence of all possible minor errors. Applicants cooperation is 
requested in correcting any errors of which applicant may become aware in the 
specification. 

Drawings 

4. The drawings are objected to as failing to comply with 37 CFR 1 .84(p)(5) 
because they include the following reference character(s) not mentioned in the 
description: 32' of Fig. 12. Corrected drawing sheets in compliance with 37 CFR 

1 .121(d), or amendment to the specification to add the reference character(s) in the 
description in compliance with 37 CFR 1.121(b) are required in reply to the Office action 
to avoid abandonment of the application. Any amended replacement drawing sheet; 
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should include all of the figures appearing on the immediate prior version of the sheet, 
even if only one figure is being amended. Each drawing sheet submitted after the filing 
date of an application must be labeled in the top margin as either "Replacement Sheet" 
or "New Sheet" pursuant to 37 CFR 1.121(d). If the changes are not accepted by the 
examiner, the applicant will be notified and informed of any required corrective action in 
the next Office action. The objection to the drawings will not be held in abeyance. 

5. Since the lengthy specification has not been checked to the extent necessary to 
determine the presence of all possible minor errors, Applicant's cooperation is 
requested in correcting any errors of which applicant may become aware in the 
drawings. For example, the drawings should be carefully checked to ensure that all 
reference numerals are described in the specification, that no one reference numeral 
describes two separate drawing elements, or that the specification contains no 
reference to numerals not in the drawings. 

Claim Objections 

6. Claims 4-6, 10, 18, and 19 are objected to because of the following informalities: 

a. Claim 4 recites "original multimedia object data," in line 5. This claimed 
limitation is unclear according to Claim 3 image is associated multimedia object 
data. Thus, original multimedia object data should be written as multimedia 
object data. Claims 5 and 6 recite similar phraseology. 

b. Claim 10 recites a parenthetical phrase in lines 3-4. It is unclear if this is 
claimed subject matter. 
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c. Claim 18 recites "set an input multimedia object data in and to the" and 
"multimedia object data one of set in and input to the" in lines 9-10 and lines 14- 
15, respectfully. This phraseology makes poor sentence structure in the claims. 
Claim 19 recites similar phraseology. 
Appropriate correction is required. 

Claim Rejections - 35 USC § 102 

7. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

8. Claims 1-6, 9, 10, 13-15, and 17 are rejected under 35 U.S.C. 102(b) as being 
anticipated by U.S. Patent No. 5,751 ,286 (Barber et al.). 

Claim 1 can be mapped to Barber as follows: "A method for setting a retrieval 
condition [Barber, col. 7, lines 7-19] when retrieving similar multimedia object data from 
a multimedia object database [Barber, col. 7, lines 7-10] on the basis of the retrieval 
condition set by a user, [Barber, col. 7, lines 7-19] the method comprising: 

• displaying a retrieval condition setting area for retrieval condition setting as an 
independent area; [Barber, col. 5, lines 4-18] and 

• setting a retrieval condition on the basis of one of multimedia object data which 
has been set in the retrieval condition setting area and multimedia object data 
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which has been input to the retrieval condition setting area" [Barber, col. 5, lines 
4-18 with Barber, col. 7, lines 7-19]. 
Claim 2 can be mapped to Barber as follows: "The method according to claim 1 , 
wherein the multimedia object data which has been set in the retrieval condition setting 
area comprises one of: inquiry object data which has been set as a retrieval condition; 
and one of an image and item associated with inquiry object data" [Barber, col. 5, lines 
4-18 with Barber, col. 7, lines 7-19 with Barber, Fig. 5]. 

Claim 3 can be mapped to Barber as follows: "The method according to claim 1 , 
further comprising: 

• displaying an object data list display area for displaying images associated with 
respective data in the multimedia object database, [Barber, col. 5, lines 4-18 with 
Barber, col. 7, lines 7-19 with Barber, Fig. 5] wherein 

• by selecting at least one multimedia object data from the object data list display 
area, the selected multimedia object data is displayed in the retrieval condition 
setting area and a retrieval condition is set" [Barber, col. 5, lines 4-18 with 
Barber, col. 7, lines 7-19 with Barber, Fig. 5]. 

Claim 4 can be mapped to Barber as follows: "The method according to claim 3, 
wherein in response to operation of a control button for setting object data into the 
retrieval condition setting area, disposed near one of an image and item associated with 
original multimedia object data in the object data list display area, the original 
multimedia object data is displayed in the retrieval condition setting area and a retrieval 
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condition is set" [Barber, cols. 8-9, lines 65-4 with Barber, col. 1 1 / lines 45-55 with 
Barber, col. 10, 35-38]. 

Claim 5 can be mapped to Barber as follows: "The method according to claim 3, 
wherein in response to direct specification of one of an image and item associated with 
original multimedia object data in the object data list display area, the original 
multimedia object data is displayed in the retrieval condition setting area and a retrieval 
condition is set" [Barber, col. 5, lines 4-18 with Barber, col. 7, lines 7-19 with Barber, 
Fig. 5 with Barber, col. 10, 35-38]. 

Claim 6 can be mapped to Barber as follows: "The method according to claim 3, 
wherein in response to operation of a pointing device to specify one of an image and 
item associated with original multimedia object data in the object data list display area 
and move it onto the retrieval condition setting area, the original multimedia object data 
is displayed in the retrieval condition setting area and a retrieval condition is set" 
[Barber, col. 5, lines 4-18 with Barber, col. 7, lines 7-19 with Barber, Fig. 5 with Barber, 
col. 4, lines 55-59]. 

Claim 9 can be mapped to Barber as follows: "The method according to claim 1 , 
wherein 

• the retrieval condition is set according to a plurality of feature values calculated 
from a multimedia object, [Barber, coL 7, lines 32-43 with Barber, col. 16, lines 
14-18] 

• the retrieval condition setting area has a plurality of feature setting areas, 
[Barber, col. 7, lines 7-20 with Barber, col. 7, lines 32-35] and 
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• the feature setting areas are assigned feature kinds which are set according to 
one of: the feature values; and a combination of the feature values" [Barber, col. 
7, lines 7-20 with Barber, cols. 10-11, lines 65-21]. 

Claim 10 can be mapped to Barber as follows: "The method according to claim 9, 
wherein the feature setting areas are arranged and displayed in an n by m (where n and 
m are natural numbers) matrix form in the retrieval condition setting area" [Barber, col. 
7, lines 13-20]. 

Claim 13 can be mapped to Barber as follows: 'The method according to claim 9, 
wherein 

• the retrieval condition is set according to a combination of feature values which 
have been set in respective feature setting areas provided in the retrieval 
condition setting area, [Barber, col. 7, lines 13-20 with Barber, cols. 10-11, lines 
65-21 with Barber, col. 9, lines 20-25] and 

• a method of the combination is set by the user" [Barber, col. 7, lines 13-20]. : 
Claim 14 can be mapped to Barber as follows: The method according to claim 9, 

wherein 

• inquiry object data is set and disposed in an arbitrary position in the retrieval 
condition setting area, [Barber, col. 9, lines 25-35] and 

• a weight of set feature values is set according to a position in which the inquiry 
object data is set and disposed" [Barber, col. 9, lines 35-61]. 

Claim 15 can be mapped to Barber as follows: "The method according to claim 1, 
wherein at the time of retrieval condition setting, attribute information owned by a 
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multimedia object is set as a keyword in combination" [Barber, col. 6, lines 17-22 with 
Barber, col. 6, lines 30-35 with Barber, col. 6, lines 50-56]. 

Claim 17 can be mapped to Barber as follows: "The method according to claim 
1 , wherein the retrieval condition setting area is displayed in a display screen of a 
display device which is independent in hardware from an apparatus for executing actual 
retrieval" [Barber, col. 4, lines 47-64 with Barber, Figs. 1 and 5]. 

Claim Rejections - 35 USC § 103 

9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

10. This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant is advised of the obligation 
under 37 CFR 1.56 to point out the inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 1 03(a). 
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11. Claims 7, 8, 18, and 19 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over U.S. Patent No. 5,751 ,286 (Barber et al.) in view of U.S. Patent No. 
5,930,783 (Li et al.). 

For Claim 7, Barber teaches: "The method according to claim 2, wherein the; 
inquiry object data is set in the retrieval condition setting area by one of." 

Barber discloses the above limitation but does not expressly teach: 

• "inputting it via an external object data input unit connected to a retrieval 
apparatus to which the method according to claim 2 is applied; 

• selecting it from an external database; and 

• taking in an object data file owned by the user." 

With respect to Claim 7, an analogous art, Li, teaches: 

• "inputting it via an external object data input unit connected to a retrieval 
apparatus to which the method according to claim 2 is applied; 

• selecting it from an external database; and 

• taking in an object data file owned by the user." [Li, col. 11, lines 55-62 with Li, 
col. 17, lines 30-39 with Li, Fig. 12]. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to combine Li with Barber because both inventions are directed towards 
searching for multimedia objects based on a query. 

Li's invention would have been expected to successfully work well with Barber's 
invention because both inventions use computers, queries and at least a database. 
Barber discloses an image query system and method comprising finding similar images 



Application/Control Number: 10/695,170 Page 10 

Art Unit: 2161 

to an inputted query image, however Barber does not expressly disclose using 
thumbnails other than the ones provided. Li discloses semantic and cognition based 
image retrieval comprising the use of external files as base query images. 

It would have been obvious to one of ordinary skill in the art at the time of : 
invention to take the use of external files as base query images from Li and install it into 
the invention of Barber, thereby offering the obvious advantage of being able to query 
based on any image as an input thumbnail. 

For Claim 8, Barber (as modified by Li) fails to teach that an Internet address is a 
file path. Official Notice is taken that it is old and well known in the Internet art to get the 
advantage of accessing files on the internet by using Internet addresses as a file path. 
It would have been obvious to one of ordinary skill in the art at the time of the invention 
to include Internet addresses as file paths to get this advantage. 

For Claim 18, Barber teaches: "An apparatus for setting a retrieval condition 
[Barber, col. 7, lines 7-19] when retrieving similar multimedia object data from various 
multimedia object [Barber, col. 7, lines 7-10] on the basis of the retrieval condition set by 
a user, [Barber, col. 7, lines 7-19] the apparatus comprising: 

• a display device having a display screen in which a retrieval condition setting 
area for retrieval condition setting is displayed as an independent area; [Barber, 
col. 5, lines 4-18] 

• an input unit configured to one of set and input multimedia object data in and to 
the retrieval condition setting area displayed on the display screen of the display 
device; [Barber, col. 4, lines 55-60 with Barber, col. 5, lines 3-18] and 



Application/Control Number: 10/695,170 Page 11 

Art Unit: 2161 

• a retrieval condition setting unit configured to set a retrieval condition on the 
basis of multimedia object data one of set in and input to the retrieval condition 
setting area by the input unit" [Barber, col. 5, lines 4-18 with Barber, col. 7, lines 
7-19]. 

Barber discloses the above limitations but does not expressly teach: "databases." 

With respect to Claim 18, an analogous art, Li, teaches: "databases" [Li, col. 4, 
lines 64-67 with Li, col. 1 3, lines 37-41]. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to combine Li with Barber because both inventions are directed towards 
searching for multimedia objects based on a query. 

Li's invention would have been expected to successfully work well with Barber's 
invention because both inventions use computers, queries and at least a database. 
Barber discloses an image query system and method comprising finding similar images 
to an inputted query image, however Barber does not expressly disclose databases of 
multimedia objects. Li discloses semantic and cognition based image retrieval 
comprising searching databases of multimedia objects. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to take the databases of multimedia objects from Li and install it into the 
invention of Barber, thereby offering the obvious advantage of being able to pull/query 
multiple databases so as to acquire more information that satisfies the query. 

Claim 19 encompasses substantially the same scope of the invention as that of 
Claim 18, in addition to an apparatus and some means for performing the apparatus 
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unit actions of Claim 18. Therefore, Claim 19 is rejected for the same reasons as stated 
above with respect to Claim 1 8. 

12. Claims 11 and 12 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over U.S. Patent No. 5,751,286 (Barber et al.) in view of U.S. Patent No. 6,748,398 
(Zhang et al.). 

For Claim 11, Barber teaches: "The method according to claim 1, wherein the 
retrieval condition setting area comprises." 

Barber discloses the above limitation but does not expressly teach: "a dissimilar 
feature setting area for setting a dissimilarity condition independently for each of 
selected objects." 

With respect to Claim 1 1, an analogous art, Zhang, teaches: "a dissimilar feature 
setting area for setting a dissimilarity condition independently for each of selected 
objects" [Zhang, col. 7, lines 27-36]. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to combine Zhang with Barber because both inventions are directed towards 
searching for multimedia objects based on a query. 

Zhang's invention would have been expected to successfully work well with 
Barber's invention because both inventions use computers, queries and at least a 
database. Barber discloses an image query system and method comprising finding 
similar images to an inputted query image, however Barber does not expressly disclose 
denoting thumbnails as related or not related to an image being queried. Zhang 
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discloses a relevance maximizing, iteration minimizing, relevance-feedback, content- 
based image retrieval (CBIR) comprising marking images as related or not related to an 
image the user is searching for. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to take the marking images as related or not related from Zhang and install it 
into the thumbnails (which are images) of Barber, thereby offering the obvious 
advantage of narrowing the search for relevant images. 

Claim 12 can be mapped to Barber (as modified by Zhang) as follows: "The method 
according to claim 1 1 , wherein 

• for each of feature values, similar and dissimilar feature setting areas are 
provided as an adjacent pair, [Zhang, col. 7, lines 27-36] and 

• a plurality of pairs are arranged in an n by m (where n and m are natural 
numbers) matrix form" [Barber, col. 7, lines 13-20]. 

13. Claim 16 is rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. 
Patent No. 5,751,286 (Barber et al.) in view of U.S. Patent No. 6,363,376 (Wiens et al.). 
For Claim 16, Barber teaches: "The method according to claim 1 , wherein 

• a result of retrieval conducted by using the retrieval condition which has been set 
is displayed in a list form in a retrieval result list display area, on the basis of one 
of: an order of similarity; and an order of a result of rearrangement when the user 
has conducted a rearrangement operation on the retrieval result, [Barber, col. 7, 
lines 47-56 with Barber, col. 8, lines 45-55] and 
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• a retrieval condition is set by one of: displaying as many high-ranking multimedia 
object data as a preset number on the basis of an order of display; and selecting 
at least one multimedia object data from the retrieval result list display area and 
displaying the at least one multimedia object data in the retrieval condition setting 
area" [Barber, col. 8, lines 45-55]. 

Barber discloses the above limitations but does not expressly teach: 

• "in the retrieval condition setting area." 

With respect to Claim 16, an analogous art, Wiens, teaches: 

• "in the retrieval condition setting area" [Wiens, col. 7, lines 25-36]. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to combine Wiens with Barber because both inventions are directed towards 
searching for information and returning a certain number of results. 

Wiens's invention would have been expected to successfully work well with : 
Barber's invention because both inventions use computers for searching. Barber 
discloses an image query system and method comprising searching for images and 
displaying a pre-specified number of results in a results listing, however Barber does not 
expressly disclose that this pre-specified number is set in the retrieval condition setting 
area by a user. Wiens discloses a method and system for querying and posting to 
multiple career websites on the internet from a single interface comprising the user 
setting the number of results returned from a search in an area that must be equivalent 
to the retrieval condition setting area. 
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It would have been obvious to one of ordinary skill in the art at the time of 
invention to take the user setting the number of results returned from a search from; 
Wiens and install it into the invention of Barber, thereby offering the obvious advantage 
of having a more user-friendly user interface that, also, saves computations by limiting 
the number of results returned. 
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Conclusion 

14. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Applicant is advised that, although not used in the rejections 
above, prior art cited on the PTO-892 form and not relied upon is considered materially 
relevant to the applicant's claimed invention and/or portions of the claimed invention. 

15. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Brent S. Stace whose telephone number is 571-272- 
8372 and fax number is 571-273-8372. The examiner can normally be reached on M-F 
9am-5:30pm EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jeffrey A. Gaffin can be reached on 571-272-4146. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contacUhe^Electroryc 
Business Center (EBC) at 866-217-9197 (toll-free). 
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